Using  Neural  Network  Parametrizations  of  the  Nonlinear  Energy  Transfer 

for  Application  in  Wave  Models 

Hendrik  L.  Tolman 

Ocean  Modeling  Branch,  Environmental  Modeling  Center, 

National  Centers  for  Environmental  Prediction,  NWS,  NOAA, 

5200  Auth  Rd.,  Camp  Springs,  MD 

phone:  (301)763-8000x7253  fax:  (301)763-8545  email:  Hendrik.Tolman@noaa.gov 

Dmitry  V.  Chalikov 

Ocean  Modeling  Branch,  Environmental  Modeling  Center, 

National  Centers  for  Environmental  Prediction,  NWS,  NOAA, 

5200  Auth  Rd.,  Camp  Springs,  MD 

phone:  (301)763-8000x7239  fax:  (301)763-8545  email:  Dmitry.Chalikov@noaa.gov 

Vladimir  M.  Krasnopolsky 

Ocean  Modeling  Branch,  Environmental  Modeling  Center, 

National  Centers  for  Environmental  Prediction,  NWS,  NOAA, 

5200  Auth  Rd.,  Camp  Springs,  MD 

phone:  (301)763-8000  x  7262  fax:  (301)763-8545  email:  Vladimir.Krasnopolsky@noaa.gov 

Award  Number:  N000 14-00-0332 
http://polar.wwb.noaa.gov/omb/papers/tnl92/NNIA.html 


LONG-TERM  GOALS 

Considering  the  crucial  importance  of  nonlinear  interaction  Sni  for  the  development  of  third  generation 
wave  models  the  long-term  goal  of  this  work  is  to  improve  accuracy  of  calculating  nonlinear 
interaction  S„i  i n  wind  wave  models,  and  hence  improving  wave  prediction  in  general. 

OBJECTIVES 

The  objective  of  this  work  is  to  develop  a  computationally  cheap  yet  accurate  approximation  for  S„u 

APPROACH 

The  approach  is  based  on  the  neural  networks  (NN)  technique.  It  is  used  to  accelerate  the  calculations 
and  improve  the  accuracy  of  the  parameterization  of  nonlinear  interaction  S„i.  The  nonlinear 
interaction  source  term  can  be  considered  as  a  nonlinear  mapping  between  a  source  term  S„i  and  a 
spectrum  F 


Snl  =  T(F)  , 


(1) 


where  T  in  is  the  exact  nonlinear  operator  given  by  the  full  Bolzmann  interaction  integral  [1],  This 
algorithm  is  a  factor  104  too  expensive  for  use  in  operational  wave  models.  We  intend  to  use  the  NN 
technique  to  produce  a  cheap  and  accurate  alternative  approach. 
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NNs  are  a  generic  tool  for  fast  and  accurate  approximation  of  continuous  mappings  and,  therefore,  can 
be  used  to  replace  the  exact  algorithm.  In  order  to  convert  the  mapping  (1)  to  a  continuous  mapping  of 
two  finite  vectors  (independent  of  the  actual  spectral  discretization),  the  spectrum  F  and  source 
function  S„i  are  expanded  using  systems  of  two-dimensional  functions  each  of  which  (O,  and  'Fq) 
creates  a  complete  and  orthogonal  two-dimensional  basis 


f  =  (2) 

1=1  q— 1 

where  for  Xj  and  yq  we  have 

y,=JJs.,4>,  ,  (3) 

where  the  double  integral  identifies  integration  over  the  spectral  space.  Because  both  sets  of  basis 

functions  { }i=i, and  { xFq\q=i . <*,  are  complete,  increasing  n  and  m  in  (2)  improves  the  accuracy  of 

approximation,  and  any  spectrum  F  and  source  function  S„i  can  be  approximated  by  (2)  with  a  required 
accuracy.  Substituting  (2)  into  Eq.  (  3)  we  can  get 

Y  =  T  (X),  (4) 

which  represents  a  continuous  mapping  of  the  finite  vectors  X  e  91"  and  Y  e  91 111 ,  and  where  T  still 
represents  the  full  nonlinear  interaction  operator.  As  described  in  the  previous  section,  this  operator 
can  be  approximated  with  a  NN  with  n  inputs  and  m  outputs  and  k  neurons  in  the  hidden  layer 

Y~Tm(X).  (5) 

The  accuracy  of  this  approximation  ( TNN )  is  determined  by  k,  and  can  generally  be  improved  by 
increasing  k. 

To  train  the  NN  approximation  Tm  of  T,  a  training  set  has  to  be  created  which  consists  of  pairs  of 
vectors  X  and  Y.  To  create  this  training  set,  a  representative  set  of  spectra  Fp  has  to  be  generated  with 
corresponding  (exact)  interactions  S„i,P.  For  each  pair  (F,  Sni)p,  the  corresponding  vectors  (X,Y)P  are 
determined  using  Eq.  (3).  All  pairs  of  vectors  are  then  used  to  train  the  NN  to  obtain  TNN. 

After  Tnn  has  been  obtained  by  training,  the  resulting  NN  Interaction  Approximation  (NNIA) 
algorithm  consists  of  three  steps  : 

(1)  Decompose  F  by  applying  Eq.  (3)  to  calculate  X. 

(2)  Estimate  Y  from  X  using  Eq.  (5). 

(3)  Compose  S„i  from  Y  using  Eq.  (2). 
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WORK  COMPLETED 


This  year  we  completed  a  study,  which  addressed  the  basic  feasibility  of  the  NNIA  approach.  We  (1) 
select  basis  functions  d>,  and  *Fq  and  the  number  of  each  (n,m);  (2)  designed  a  NN  topology  (number  of 
neurons  k)\  (3)  constructed  a  representative  training  set;  and  (4)  selected  training  strategies.  The  first 
three  issues  all  have  a  significant  impact  on  both  accuracy  and  economy  of  a  NNIA.  Unfortunately, 
there  is  no  pre-defined  way  to  tackle  these  issues.  It  is  therefore  unavoidable  that  the  development  of  a 
NNIA  involves  many  iterations.  This  year  we  completed  the  first  iteration.  The  major  requirement  of 
an  NNIA  to  be  potentially  useful  in  operational  wave  modeling,  is  that  the  exact  interactions  Sni  are 
closely  reproduced  for  computational  costs  comparable  to  that  of  the  DIA.  The  feasibility  study  we 
have  completed  showed  the  potential  of  this  approach  with  the  design  of  a  simple  ad-hoc  NNIA. 

RESULTS 

We  have  considered  an  NNIA  to  estimate  the  nonlinear  interactions  Sni(f,9)  as  a  function  of  frequency/ 
and  direction  9  from  the  corresponding  spectrum  F(f  9)  in  deep  water  only.  To  train  and  test  this 
NNIA,  we  used  a  set  of  about  20,000  simulated  realistic  spectra  for  F(f  9),  and  the  corresponding  exact 
estimates  of  Sni(f,9)  [2].  Simulation  has  been  performed  using  a  generator  that  calculated  a  spectral 
function  composed  of  several  Pierson-Moskowitz  spectra  for  different  peak  frequencies  oriented 
randomly  in  [0,27i]  interval.  Comparison  of  simulated  spectra  with  spectra  simulated  by 
WAVEWATCH  model  [3,  4]  shows  that  this  approach  allowed  us  to  simulate  reasonably  realistic  and 
complicated  spectra  describing  a  broad  range  of  wave  systems.  Spectra  with  four  peaks  were  used  in 
calculations  below.  Separate  data  sets  have  been  generated  for  training  and  validation. 

As  is  common  in  parametric  spectral  descriptions,  we  choose  separable  basis  functions  where 
frequency  and  angular  dependence  are  separated.  For  0,  this  implies 

0i(f,9)^0iJ=^i(f)tJ9)  (6) 

A  similar  separation  is  used  for  'Fq.  Considering  the  strongly  suppressed  behavior  of  F  and  S„i  for/— > 
0,  and  the  exponentially  decreasing  asymptotic  for/— »  °°,  generalized  Laguerre's  polynomials  are  used 
to  define  0/  and  y/f.  Considering  that  no  directional  preferences  exist  in  F  and  S„i,  a  Fourier 
decomposition  is  used  for  0g  and  y/g.  The  number  of  base  functions  is  chosen  to  be  n  =  51  and  m  =  64 
to  keep  the  accuracy  of  approximation  for  F  on  average  better  than  2%  and  for  S„i  -  better  than  5-6%. 
The  number  of  hidden  neurons  was  taken  k  =  30  which  allows  a  satisfactory  approximation  (5)  for  the 
mapping  (4). 


Table  1.  RMSE  statistics  for  10,000  S„i 


Mean 

RMSE 

CtRMSE 

Max  RMSE 

DIA 

0.0133 

0.0111 

0.104 

NNIA 

0.0068 

0.0063 

0.065 
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f  Angle 


Figure  1.  RMSE  as  functions  of frequency  f  and  angle.  Dashed  line  -  error  of  approximation 
( lower  bound  for  all  other  errors).  Solid  line  -  DIA,  line  with  squares  -  NNIA  (51:20:64),  and  line 

with  triangles  -  NNIA  (51:30:64) 


Table  1  compares  three  important  statistics  for  source  function  RMS  errors  (with  respect  to  exact 
solution)  calculated  using  DIA  and  NNIA  for  10,000  spectra  (independent  validation  set).  NNIA 
improves  accuracy  about  twice  as  compared  with  DIA. 

Figure  1  shows  mean  RMSE  as  function  of  the  frequency  f  (left)  and  the  angle  0  (right).  Numbers  in 
Table  1  correspond  to  NNIA  with  NN  with  30  neurons  in  the  hidden  layer  (51:30:64). 

Figure  2  shows  3  pairs  (one  row  in  the  figure  corresponds  to  one  pair)  of  one  dimensional,  integrated 
over  0,  source  functions  Sni  (f)  (left  column)  and  one  dimensional,  integrated  over  f,  source  functions 
Sm( 6)  (right  column)  from  the  validation  data  set.  Thick  solid  curves  correspond  to  the  exact  S„i. 
Dashed  curves  correspond  to  DIA  of  S„i.  Curves  with  triangles  correspond  to  the  NNIA  estimate  of 
S„i.  Numbers  inside  the  panels  show  DIA  and  NNIA  errors  in  percents  with  respect  to  exact  solution. 


4 


L _ _ i . . .  ..  .  J 

O+0OP.lCO  +  2flO  +  3OO  +  40Qi  +  !jO 


Ci  ,00  4 
0,002 

0.000 
-0,002 
-0.004 

-o.ooe 
-o.oos 

t 

0,0010 
0.0000 

-c.ooio 

-0,0020 

-0,0030 
-C.OOJQ 

0  2  4  6  8 

0.010 

0,000 

-0.010 

-0t020 

-0.0^0 

0  2  4  6  6 

finqle 


Figure  2.  See  explanations  in  the  text  above. 


The  results  in  Fig.  2  are  fairly  representative  for  the  validation  data  set.  In  general,  the  NNIA 
reproduces  the  exact  Sni  accurately.  Even  if  clear  oscillations  are  present  in  the  decomposed  spectrum 
(e.g.,  line  in  middle  panel  on  left),  the  NNIA  shows  no  spurious  oscillations,  and  gives  reasonable 
results.  Note  that  many  DIA  source  functions  exhibit  complicated  behavior  and  spurious  oscillations. 
Major  peaks  in  these  functions  coexist  with  more  or  less  random  small-scale  fluctuations.  These 
fluctuations  are  probably  an  artifact  produced  by  a  simplified  nature  of  DIA.  Exact  interactions  are  the 
result  of  averaging  over  much  lager  number  of  resonant  sets  of  wave  numbers,  and  are  therefore  much 
smoother  than  the  results  of  the  DIA. 

IMPACT/APPLICATIONS 

The  NNIA  under  development  is  intended  for  implementation  in  operational  wave  models  such  as 
WAVEWATCH. 
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TRANSITIONS 


The  resulting  NNIA  algorithm  will  be  transitioned  to  other  members  of  the  AWPP-SNL  group  upon 
completion. 

RELATED  PROJECTS 

AWPP-SNL  group 
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